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Many complex systems can be represented as networks of dynamical elements whose states evolve 
in response to interactions with neighboring elements, noise and external stimuli. The collective 
behavior of such systems can exhibit remarkable ordering phenomena such as chimera order corre¬ 
sponding to coexistence of ordered and disordered regions. Often, the interactions in such systems 
can also evolve over time responding to changes in the dynamical states of the elements. Link 
adaptation inspired by Hebbian learning, the dominant paradigm for neuronal plasticity, has been 
earlier shown to result in structural balance by removing any initial frustration in a system that 
arises through conflicting interactions. Here we show that the rate of the adaptive dynamics for the 
interactions is crucial in deciding the emergence of different ordering behavior (including chimera) 
and frustration in networks of Ising spins. In particular, we observe that small changes in the link 
adaptation rate about a critical value result in the system exhibiting radically different energy land¬ 
scapes, viz., smooth landscape corresponding to balanced systems seen for fast learning, and rugged 
landscapes corresponding to frustrated systems seen for slow learning. 


I. INTRODUCTION 

Many natural and technological complex systems can 
be described as networks connecting a large number of 
elements whose states evolve in time [I|, . The collective 

behavior of a system resulting from interactions between 
its components can exhibit non-trivial features, includ¬ 
ing critical phenomena For instance, a system of 
binary-state elements (e.g., representing individuals hav¬ 
ing opposing opinions on an issue) connected through a 
network having modular organization can exhibit order¬ 
ing dynamics at very distinct time-scales Q and under 
certain circumstances, self-organize into locally aligned 
clusters that correspond to the communities of the net¬ 
work (i.e., subnetworks characterized by a significantly 
higher connection density compared to the overall den¬ 
sity of the network) Q. In many situations, the links 
of the network (representing the interactions) can also 
evolve over time as a result of the changes in the states 
of the components that they connect. Such connections 
may not only be characterized by weights (indicating the 
strength of interaction) but also sign (representing the 
nature of the interaction). For instance, in the context 
of a network of synaptically-connected model neurons, 
positive links may correspond to excitatory interactions 
(whereby activation of one element can result in activa¬ 
tion of other connected elements) while negative links 
can give rise to inhibition (i.e., activation of an element 
tends to smpress subsequent activation of neighboring 
elements) Q. 

The occurrence of negative links can lead to the emer¬ 
gence of frustration because of the existence of inconsis¬ 
tent relations within cycles in the network 0, @1 ■ ^ net¬ 
work is said to be structurally balanced if its positive and 
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negative links are arranged such that frustration is ab¬ 
sent. Such a network can always be represented as two 
communities, with interactions within each community 
being exclusively positive while those between communi¬ 
ties can only be negative Q. This is of interest not only 
for social systems in the context of which the concept 
of balance was first introduced 0, but also for biologi¬ 
cal systems. For instance, it has been recently observed 
that the resting human brain is organized into a pair of 
dynamically anti-correlated subnetworks [HI- This sug¬ 
gests that the network responsible for this behavior may 
be structurally balanced. This possibility is intriguing in 
view of the observation of non-trivial collective behav¬ 
ior in balanced networks of binary-state dynamical ele¬ 
ments, such as, the coexistence of ordered and disordered 
regions referred to as “chimera” order, in the presence of 
an external field [l^ . The process by which networks can 
evolve to a balanced configuration has been explored by 
considering a link adaptation process inspired by Hebb’s 
principle, the basis behind neural plasticity [l3[. Ac¬ 
cording to this mechanism, weights associated with each 
link change in proportion to the correlation in the ac¬ 
tivity of the connected elements. Therefore, any initial 
frustration in the network can be removed by modifying 
the connection weights in accordance with the dynami¬ 
cal states of the elements. Systems undergoing such link 
adaptation in the presence of environmental noise show 
high variability in the convergence time required to reach 
the balanced state [14 1. 


In this paper we consider how the rate of dynamical 
evolution of interactions in accordance with the Hebbian 
adaptation principle affects the collective behavior of the 
network. Starting from a fully connected network that is 
structurally balanced and introducing noise and external 
field so that the system exhibits chimera order, we show 
that different rates of adaptation can result in distinct 
outcomes. Fast learning rates result in persistence of 
the chimera regime, although the balanced network now 
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comprises communities with asymmetric sizes, viz., the 
ordered sub-network containing a much larger fraction 
of elements of the network. Slow learning, on the other 
hand, results in a completely ordered state with the inter¬ 
actions becoming only of positive nature. On removing 
the external field, fast learning results in retrieving a net¬ 
work that is similar to the original one, i.e., structurally 
balanced with communities of almost equal size. How¬ 
ever, slow learning gives rise to a fully frustrated network 
exhibiting disorder. We observe that there exists a criti¬ 
cal interval for values of the learning rate, around which 
small changes result in the system converging to distinct 
final states. In the following sections we first discuss the 
model and adaptation dynamics, followed by description 
of the results of numerical simulations. We conclude with 
a brief summary of our results and a discussion of their 
implications. 


II. THE MODEL 

For the purpose of investigating how collective behav¬ 
ior of a complex system is affected by adaptive dynamics 
of interactions, we use one of the well-known spin mod¬ 
els of statistical physics which are generic systems for 
analyzing cooperative phenomena. In particular, we use 
the binary-state Ising spin, the spin orientations (“up” 
or “down”) representing a pair of mutually exclusive 
choices. The simplicity of the model makes it appli¬ 
cable to not just magnetic materials (in the context of 
which it was originally proposed) but any system where 
the elements choose between the two competing states 
based on interactions with neighboring elements, noise 
(represented by thermal fluctuations characterized by a 
temperature T) and external stimulus (often represented 
by a magnetic field H). The interactions Jij between 
any pair of spins {i, j) can be either positive (promot¬ 
ing connected spins to have the same state) or negative 
(promoting connected spins to have opposite states) in 
nature. For instance, in neuronal networks, one can view 
the neurons as binary-state devices that are either fir¬ 
ing (active) or quiescent (inactive). Correspondingly, as 
pointed out earlier, the excitatory and inhibitory connec¬ 
tions between neurons can be represented by positive and 
negative interactions, respectively. At a different scale, 
one can view genetic regulatory networks in a similar 
vein, with genes being in either of two states, viz., get¬ 
ting expressed (active) or not (inactive). In this setting, 
genes promoting the expression of other genes correspond 
to positive interaction, while inhibiting the expression of 
other genes correspond to negative interactions. In a dif¬ 
ferent context, the interactions between Isin g sp ins can 
also be used to represent social intercourse [l^- Here, 
the spin states are considered to be analogous to two 
competing opinions, while the interactions may represent 
the nature of the relation between a pair of individuals 
- positive corresponding to affiliative and negative corre¬ 
sponding to antagonistic relations. 


We consider a system of 2N globally coupled Ising 
spins arranged into two sub-populations (called modules 
or communities) each having N spins, at a constant tem¬ 
perature T. For the simulations reported below we have 
chosen N = 100. The interaction between a pair of spins 
belonging to the same module is positive having strength 
J (> 0), while that between spins belonging to different 
modules is negative with strength — J' (where J' > 0). In 
the absence of an external held and thermal huctuations 
(i.e., H — 0, T = 0), the two modules will be completely 
ordered in opposite orientations. When subjected to an 
external held of strength H, the energy of the system is 
described by 

E — J ^ ) ^ioL^j a J ^ ^ FI ^ ; (1) 

where aia = ±I is the Ising spin on the z-th node 
{i,j = \,2,...N) in the a-th module (a,/3 = 1,2). As 
every spin interacts with every other spin, a mean-held 
treatment should describe the system accurately. For 
convenience we dehne a = J{N — l)/2 and b = J'N as 
system parameters. The state of all spins in the system 
are updated stochastically at discrete time-steps using 
the Metropolis Monte Carlo (MC) algorithm with tem¬ 
perature T expressed in units of ksT/ J where ks is the 
Boltzmann constant. The initial state of the system we 
have chosen is one exhibiting chimera order [l2|, to ob¬ 
tain which we use a = 1, 6 = iF = 10 and fc^T/J = 5. 

We also allow the possibility that the interaction 
strengths can change over time through an adaptation 
process inspired by the principle of Hebbian learning, a 
classical concept in the area of neural networks M- Col¬ 
loquially often described as “neurons that fire together, 
wire together”, in this mechanism the strength of synap¬ 
tic connection between a pair of neurons is incremented 
when the two exhibit correlated activation. In Ref. [T3| . 
this idea was used to propose a link adaptation rule that 
applies to a system of spins coupled via positive, as well 
as, negative interactions as: 

Jy (t -h 1) = (I - e)Jy (t) -b (2) 

which is applied after every MC step. The adaptation 
rate, e, decides the time-scale over which the interaction 
strength changes relative to the spin dynamics. Starting 
with an initially frustrated spin system, implementing 
the above Jy dynamics in absence of thermal fluctua¬ 
tions (i.e., T = 0) results in the system converging to a 
structurally balanced state M- This can be intuitively 
understood in terms of changes in the energy landscape 
over which the state of the spin system evolves. Frus¬ 
trated systems have rugged energy landscapes compris¬ 
ing a large number of local minima (a fact which is ex¬ 
ploited in neural network models of associative memory 
where these minima are used to embed desired patterns 
one wishes the network to “memorize” [I1[I3. Thus, 
beginning at any randomly chosen initial state of spin 
conhgurations, the spin dynamics drives the system into 
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FIG. 1. Typical time-evolution of the magnetizations per spin of 
the two modules, mi and m 2 , in (a) chimera ordered state and (b) 
disordered state, shown for MC simulations with N = 100 at (a) 
ksTfJ = 5 and (b) ksT/J = 8, respectively. 

the nearest local energy minimum. The subsequent evo¬ 
lution of the JijS converts this into the global minimum 
of the system. However, in the presence of noise (T > 0), 
fluctuations in the spin dynamics can prevent the system 
from being trapped in any state for sufficiently long du¬ 
ration. Thus, the adaptation dynamics fails to alter the 
energy landscape sufficiently so as to turn the configura¬ 
tion into the global minimum. Therefore, with increasing 
temperature, an extremely long time may be required to 
reach structural balance. 

In this paper we use a modified form of the Hebb- 
inspired adaptation rule for interaction strengths that 
was introduced in Ref. M- This is to take into account 
the asymmetry in the strengths of positive and negative 
interactions necessary for observing chimera order (typ¬ 
ically J' ~ 10J) [i3]. We change the adaptation rule 
such that the upper and lower bounds for the evolving 
interactions have the same values as that of the positive 
and negative interactions (respectively) which give rise 
to the chimera ordered state. Thus after each MC step, 
interaction strengths are changed according to: 

Jjj(<-t-l) = Tij(l —e)-|-e[(J-|-J')—^-|--(J—J')]. (3) 

The state of the system at any time is characterized 
by two quantities. One of these is the frustration as¬ 
sociated with the interactions, measured by calculating 
the fraction of frustrated triads (i.e., connected sets of 
3 spins with an odd number of negative interactions) in 
the system: 

F=Y. <0, (4) 

which varies between 0 (no frustration) and 1 (completely 
frustrated). 

The other quantity is an order parameter p = |toi —m 2 1 
that is used to identify a chimera state in a spin system 
with two modules that have magnetizations mi and m 2 , 
respectively. To numerically estimate the order parame¬ 
ter p, we are confronted with a few potential complica¬ 
tions. First, as the magnetizations of the two modules 
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FIG. 2. Frequency distribution of the quantity m\ — m 2 shown 
when the spin system exhibits (a) chimera order and (b) disorder. 
The kernel smoothened distribution function is represented by a 
thick curve. Results shown for MC simulations with N = 100 at 
(a) k^T/J = 5 and (b) k^T/J = 8, respectively. 


are stochastically fluctuating (especially the one which is 
disordered, i.e., having lower magnetization), we can use 
their average values. However, this gives rise to an addi¬ 
tional problem as the modules can frequently exchange 
their order/disorder status, especially when the modules 
are of the same size [Fig. [T] (a)]. Thus, a method is re¬ 
quired to measure p that is unaffected by the modules 
switching their magnetizations, while being able to deter¬ 
mine if the time-averaged magnetizations of the two mod¬ 
ules are different (the signature of chimera order). For in¬ 
stance, a simple time average of the absolute value of dif¬ 
ferences between m, and m 2 will not give correct results 
as one obtains a finite value (because of stochastic fluctu¬ 
ations) even when the time averaged magnetizations are 
same for both modules [Fig. [T] (b)]. Therefore, to esti¬ 
mate p we have used the following algorithm. First, the 
frequency distribution of mi—m 2 is computed. In the ab¬ 
sence of chimera, the distribution is unimodal [Fig. [H[a)] 
which is approximated as a Gaussian function, while for 
chimera ordering the distribution is bimodal [Fig. [ll[b)] 
which is approximated as a superposition of two Gaus¬ 
sian functions. For a unimodal distribution, the value of 
mi—m 2 corresponding to the peak is used to calculate the 
order parameter p. For bimodal distributions, a weighted 
average of the values corresponding to the peaks is used. 
For example, if one of the peaks occurs at pi with value 
hi while the other is at p 2 with value ft. 2 , the order pa¬ 
rameter is calculated as p = (/ii|pi| -I- h 2 \p 2 \)/{hi -I- h 2 ). 
In order to make the automated detection of the peak lo¬ 
cations accurate, the frequency distributions need to be 
smoothed of all fluctuations in the frequencies so that the 
local maxima at the peaks can be uniquely determined. 
For this purpose we have used a kernel smoothing tech¬ 
nique |18l [ that gives a single peak location for unimodal 
distributions and locations for two peaks in the case of 
bimodal distributions. 
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FIG. 3. Time-evolution of sizes of the modules resulting from link 
adaptation dynamics that is introduced at time t = 1000 MC steps 
(indicated by broken line). The ordered module expands in size 
(ni) while the disordered one shrinks. Learning rate e = 0.1 


III. RESULTS 

Starting from a structurally balanced network com¬ 
prising two modules, we first introduce field and thermal 
fluctuations so as to drive the system into chimera order 
- i.e., one of the modules becomes ordered while the other 
is disordered. Once this is achieved we allow adaptation 
dynamics of the interactions to take place. As the evolu¬ 
tion of the interactions are related to the degree of fluc¬ 
tuations in the spin states, these would occur mostly in 
the disordered module where the spins are subject to the 
competing forces of negative interactions with the spins 
belonging to the ordered module and the influence ex¬ 
erted by the uniform external magnetic field which tries 
to align the spins in parallel with those of the ordered 
module. Thus, at any instant, a few spins in the disor¬ 
dered module will get aligned with the spins in the other 
module and consequently may develop positive interac¬ 
tions with the latter as a result of link adaptation. This 
means that they will now no longer be part of the dis¬ 
ordered module but become part of the ordered module. 
As a result, the size of the modules would change over 
time - the ordered module increasing at the expense of 
the disordered one. This has to be taken into account 
when measuring system properties, such as, magnetiza¬ 
tion per spin of the two modules. In order to have a 
consistent definition of module size that would be valid 
even when the system is no longer in structural balance, 
we heuristically measure it as follows. At each update 
of the JijS, we randomly choose a spin from the ordered 
module and consider all spins that have positive interac¬ 
tions with it to belong to the ordered module, with the 
remaining spins comprising the disordered module. Fol¬ 
lowing this process, we can follow the time-evolution of 
modular membership of individual spins, as well as, that 
of the module sizes. However, this measure becomes less 
useful as the system becomes increasingly frustrated. 

Fig. [3 illustrates the evolution of module sizes with 
time following the introduction of link adaptation dy¬ 
namics in the system. We can now measure the mag¬ 
netizations per spin, mi and m 2 , of the two modules 
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FIG. 4. (top) Time-evolution of magnetizations mi and m 2 of the 
two modules in the network (having sizes ni and 712 , respectively) 
before and after link adaptation dynamics is introduced at time t = 
1000 MC steps (indicated by broken line). In absence of adaptation, 
magnetizations show the characteristic signature for chimera order. 
Once adaptation dynamics is operational, the ordered module with 
magnetization mi is seen to increase in size, (bottom) In absence 
of learning, the network exhibits no frustration as it is structurally 
balanced. Following the introduction of adaptation dynamics, there 
is a transient increase in frustration, before the system once again 
achieves balance, but with modules of asymmetric sizes. 



Time (MC steps) 


FIG. 5. Snapshots of the time-evolution of the interaction matrix 
J after adaptation dynamics is initiated at t = 1000 MC steps. 
Note that the time interval shown here corresponds to the same 
period over which the frustration in the system initially rises and 
then decreases again as the system once more reaches a balanced 
state, as indicated in Fig. [4| 


by taking into account the modular membership of each 
spin and the module sizes. Fig. |T] shows these order pa¬ 
rameters, as well as, the frustration in the network, as 
a function of time before and after the link adaptation 
dynamics is introduced. As expected, we observe that fol¬ 
lowing the start of link adaptation dynamics, the ordered 
module begins to grow in size, which is also observed in 
the time-evolution of the interaction matrix (shown as 
snapshots at regular intervals in Fig. [S]). 

The time-evolution of the initial chimera-ordered net¬ 
work subjected to link adaptation dynamics with various 
learning rates ranging from e = 0.1 to 10“^ are indicated 
in Figs, iniini For fast learning rates (e.g., e = 0.1), the 
system immediately converges to a balanced state char¬ 
acterized by a large ordered module (comprising about 
95% of all the elements) and a small disordered one. By 
observing the magnetization time-series of the two mod¬ 
ules in Fig. [Slit is easy to infer that the system still ex¬ 
hibits chimera order. We note that a rise in frustration 
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FIG. 6. Time-evolution of module sizes (top panel), magnetiza¬ 
tion (middle panel) and frustration (bottom panel) for an initially 
chimera ordered system in the presence of an external field before 
and after link adaptation dynamics with rate e = 0.1 is introduced 
(the time at which the link adaptation is initiated is indicated by 
the broken line). Following a brief transient rise in the frustration, 
the system again attains a balanced state although with asymmet¬ 
ric module sizes. 


FIG. 8. Time-evolution of module sizes (top panel), magnetiza¬ 
tion (middle panel) and frustration (bottom panel) for an initially 
chimera ordered system in the presence of an external field before 
and after link adaptation dynamics with rate e = 10^ is introduced 
(the time at which the link adaptation is initiated is indicated by 
the broken line). Initially, the two modules both become ordered. 
However, eventually the two modules merge into a single one as all 
interactions become positive. The time of merging coincides with 
the transient rise in frustration. 
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FIG. 7. Time-evolution of module sizes (top panel), magnetiza¬ 
tion (middle panel) and frustration (bottom panel) for an initially 
chimera ordered system in the presence of an external field before 
and after link adaptation dynamics with rate e = 0.01 is introduced 
(the time at which the link adaptation is initiated is indicated by 
the broken line). The system eventually becomes completely or¬ 
dered with all interactions becoming positive (resulting in merging 
of the two modules into a single one). 


is seen for a very brief duration during the initial period 
immediately following initiation of the link adaptation 
dynamics. For a slower learning rate, viz. e = 0.01, the 
process of expansion in size of the ordered module is dif¬ 
ferent (Fig. O. We notice that soon after the beginning 
of link adaptation, the chimera ordering is lost as the 
disordered module becomes ordered. However, the mod¬ 
ules still retain their different identities as they are de¬ 
fined based on the sign of interactions of the spins within 
them (which should be positive) and that with spins in 
the other module (which should be negative). For even 
slower learning rates such as e = 10“^ or 10“^ (Figs. [S]- 
ED the duration over which the two modules exist while 
both being ordered is seen to increase. During this pe¬ 
riod the modular membership of the spins do not change 
significantly (apart from small fluctuations). Chimera or¬ 
dering is lost as the interaction strengths for spins in the 
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FIG. 9. Time-evolution of module sizes (top panel), magnetiza¬ 
tion (middle panel) and frustration (bottom panel) for an initially 
chimera ordered system in the presence of an external field before 
and after link adaptation dynamics with rate e = 10“^ is introduced 
(the time at which the link adaptation is initiated is indicated by 
the broken line). We observe that while one of the modules remains 
ordered, the initially disordered modules is gradually also tending 
towards complete order. Eventually one expects the two modules 
to merge into a single one. 


disordered module becomes weaker as a result of frequent 
switchings of their orientations. As a result the effect of 
the external field becomes dominant, which causes the 
spins in the disordered module to align with it. As spins 
in both modules are now aligned parallel to each other, 
adaptation of their interactions with time would eventu¬ 
ally make all interactions positive, thereby merging the 
two modules into one. The time at which this happens 
is indicated by a transient rise in the frustration (Figs. [7] 
and [8]), occurring much later for slower rates of adapta¬ 
tion. 

The different scenarios we observe at fast and slow 
learning rates suggest that there is a competition between 
two processes: if the modular membership of the spins 
can change rapidly following initiation of link adaptation 
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FIG. 10. The region of chimera order in the {H,T) parameter 
space shown for different ratios of the sizes of the two modules. 
Chimera is indicated in terms of high values of the order parameter 
|mi — m 21 (represented by different colors). 


SO that the system adopts a new structurally balanced 
configuration, the interaction strengths of the spins in the 
disordered module do not decrease significantly - thereby 
allowing the two modules to coexist with the chimera or¬ 
dering intact (although the modules now have very dif¬ 
ferent sizes). Note that the modular membership of the 
spins will change rapidly as they continually change their 
interaction strengths because of the fast adaptation rate. 
However, the average number of spins in each module will 
remain fairly steady. If the learning rate is slow, the inter¬ 
action strengths will not have time to change sufficiently 
rapidly to allow the system to reach a new structurally 
balanced state following the initiation of link adaptation 
dynamics. As a result the field dominates over the weak¬ 
ened interactions of the spins in the disordered module, 
thereby eliminating chimera order and eventually causing 
the two modules to merge. 

The existence of chimera order even in situations where 
the two modules have very different sizes is a novel ob¬ 
servation as earlier it had onl y b een observed in a system 
with symmetric module sizes [12| . In order to see how the 
region in the field-temperature parameter space where we 
observe chimera ordering varies with asymmetry in the 
module sizes, we show in Fig. [10] the dependence of the 
order parameter |toi — TO 2 I on the strength of the exter¬ 
nal field (if), the scaled temperature (fc^T/J) and the 
ratio of sizes of the two modules {ni/n 2 ) in the absence 
of link adaptation dynamics. We observe that the region 
in parameter space where we find chimera order (higher 
values of |mi — m 2 \) increases significantly as we go to¬ 
wards higher module size ratios (i.e., nxjn^) especially 
for lower values of temperature. 

We now consider the situation when the external field 
is withdrawn while allowing the link adaptation dynam¬ 
ics to continue. A difference is expected with the results 
shown in the earlier work [l^ where the effect of link 
adaptation on the evolution of a system subject to ther¬ 
mal fluctuations was investigated, as the learning rule is 
different on account of the asymmetry in the strengths 
allowed for negative and positive interactions. As the 
adaptation dynamics used here allows for much stronger 
negative interactions (as compared to positive), we would 
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FIG. 11. (a) Time-evolution of magnetization (top panel) and 

frustration (bottom panel) for an initially chimera ordered system 
with link adaptation rate e = 0.1, before and after an external field 
is withdrawn (the time at which the field is switched off is indi¬ 
cated by the broken line). We observe that the system becomes 
completely frustrated on withdrawal of the field, (b) The corre¬ 
sponding time-evolution shown for link adaptation rate e = 0.01. 


expect the system to become more frustrated as negative 
interactions are much more likely to contribute frustrated 
triads. This is indeed what is observed for slow learning 
rates, e.g., e = 0.1 and e = 0.01 (Fig. [TT|). Note that 
in a frustrated system, one cannot define modules in a 
meaningful way, and thus the distinction between mod¬ 
ules indicated in the time-series for magnetization is an 
artifact of the measurement method. For both of the 
slow learning rates we observe that the system converges 
to a fully frustrated state corresponding to the maximum 
value of the measure of frustration in the system (= 1). 

For faster link adaptation rates, however, we observe 
unexpected behavior in the system. For a learning rate 
e = 0.13 [Fig. [T2|, which is only slightly higher than 
e = 0.1 [shown in Fig. |TT] (a)], the system initially be¬ 
comes fully frustrated after the external field is with¬ 
drawn. Surprisingly, after a period of ^ 2000 MC steps 
during which the system remains frustrated, it suddenly 
converges to a balanced state. This intervening period 
between the field being switched off and the system spon¬ 
taneously splitting into two modules having positive in¬ 
teractions among all elements within them (and corre¬ 
spondingly, negative interactions between elements be¬ 
longing to different modules) becomes even shorter with 
increasing learning rates (e.g., see Fig. [T3|for e = 0.15). 
Thus, we can identify a critical value of around 0.13 for 
the link adaptation rate e, below which the system re¬ 
mains frustrated and above which the system converges 
to a balanced state, on withdrawal of the external field. 
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FIG. 12. Time-evolution of module sizes (top panel), magnetiza¬ 
tion (middle panel) and frustration (bottom panel) for an initially 
chimera ordered system with link adaptation rate e = 0.13, before 
and after an external field is withdrawn (the time at which the 
field is switched off is indicated by the broken line). We observe 
that the system initially becomes completely frustrated on with¬ 
drawal of the field. However after about 2000 MC steps the system 
suddenly becomes balanced. 
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FIG. 13. Time-evolution of module sizes (top panel), magnetiza¬ 
tion (middle panel) and frustration (bottom panel) for an initially 
chimera ordered system with link adaptation rate e = 0.15, before 
and after an external field is withdrawn (the time at which the field 
is switched off is indicated by the broken line). We observe that 
the system quickly becomes balanced after a brief transient rise in 
frustration following the withdrawal of the field. 


Indeed our simulations show that at e = 0.13 there is 
a wide variation in the time required for the system to 
converge to balance after the field is switched off. 

In the previous study of structural balance [3 j it had 
been observed that the time required to converge to a 
structurally balanced state exhibits a bimodal distribu¬ 
tion for a range of temperatures. We observe similar 
features in our model also - for instance, for a link adap¬ 
tation rate of e = 0.13. For slightly slower learning rates 
(e.g., e = 0.12), the convergence time increases signifi¬ 
cantly. In our simulations, many realizations did not con¬ 
verge to the balanced state within the time of observation 
(10"'^ MC steps). For higher learning rates, the system 
rapidly converges to balance. However, unlike the con¬ 
vergence to balance seen in the previous study [3, the 
modules in the structurally balanced state that our model 
system reaches are of almost equal size (see Figs. [T^ and 
[HD independent of the initial state of the network (in¬ 


cluding the initial distribution of interactions which was 
seen to affect the nature of the balanced state that the 
system converges to in the earlier work). This may ap¬ 
pear surprising as starting from a balanced state, one 
expects that the network will remain in that state as the 
interactions adapt so as to make the corresponding en¬ 
ergy minimum even deeper. However, what we observe 
is that, on withdrawing the field the balanced state char¬ 
acterized by asymmetric module sizes is destabilized and 
the energy minimum moves in the configuration space 
eventually reaching the region corresponding to balanced 
state with modules having equal size. This difference be¬ 
tween our results and that of the previous study suggests 
that the adaptation rule used here (which is biased in 
favor of negative interactions) is responsible for an in¬ 
triguing meta-dynamics of the energy landscape itself. 

We have also observed how the structure of the energy 
landscape underlying our system evolves as the interac¬ 
tions change through the adaptation rule. In the model 
studied earlier 0, the frustration of the initially dis¬ 
ordered system is around 0.5. On initiating link adap¬ 
tation, this value decreases as the system tends towards 
balance. When frustration reaches a value around 0.49, 
we observe that the energy landscape becomes such that 
starting from any spin configuration one can reach the 
same minimum energy spin arrangement. This suggests 
that a small decrease in the frustration can accompany a 
a very large change in the basin of attraction of an energy 
minimum (which now encompasses a significant fraction 
of the configuration space). We observe similar behav¬ 
ior in our model system where the adaptation occurs in 
the presence and subsequent absence of an external field. 
For example, for an adaptation rate of e = 0.13, when 
the field is withdrawn the system initially becomes com¬ 
pletely frustrated with the value of frustration measured 
as around 0.97. The corresponding energy landscape has 
a very large number of minima, each having very small 
basins of attraction. As the system evolves towards a 
balanced state, we note that even when the frustration 
decreases by a very small amount, e.g., to 0.93, the en¬ 
ergy landscape transforms to one having an extremely 
deep energy minimum with a very large basin of attrac¬ 
tion. We believe that this radical transformation of the 
energy landscape of the system at the initial stages of 
approach to balance points to features of landscape evo¬ 
lution that deserve further study. 


IV. CONCLUSIONS 

In this paper we have explored the behavior of a spin 
system that is subjected to an external field, while the 
interactions adapt in response to the system dynamics. 
The results obtained through our simulations that is de¬ 
scribed above is summarized in Fig. 1141 From an earlier 
study, we had known that introducing link adaptation 
inspired by the Hebbian principle in a frustrated sys¬ 
tem can result in it converging to a structurally balanced 








































































































































FIG. 14. Schematic representation of our key results. Starting 
from the structurally balanced network (with the different com¬ 
munities showing opposite ordering) at the bottom left quadrant, 
we obtain chimera state on introducing an external field of req¬ 
uisite strength (top left quadrant). Allowing the interactions to 
adapt with different learning rates result in the network maintain¬ 
ing balance but with different outcomes for the ordering. Fast and 
intermediate learning rates retain chimera order, although the dis¬ 
ordered region is much diminished, while slow learning leads to 
complete order (top right quadrant). On withdrawing the field, 
the system subject to fast learning rate again converges to a struc¬ 
turally balanced network with oppositely ordered communities of 
approximately equal size, similar to the original network. Inter¬ 
mediate and slow learning, however, results in a fully frustrated 
network with complete disorder (bottom right quadrant). 


state - corresponding to evolution of the underlying en¬ 
ergy landscape - that depends on the initial state of the 
system. Applying this adaptation dynamics to a system 
exhibiting chimera order (as done in here) allows us to 
explore how the dynamics of the energy landscape is af¬ 
fected by an external field, as well as, asymmetry in the 
adaptation rule regarding negative and positive interac¬ 
tions. 

We observe that when system is adapting through 
faster learning rates, the chimera order is maintained 
throughout its evolution, with the ordered module in¬ 
creasing in size at the expense of the disordered module. 
For slower learning rates, first the interactions of the ele¬ 
ments belonging to the disordered module become weak 
which results in loss of chimera order. This is followed by 
the system converging to a fully ordered state where al¬ 
most all the interactions are positive. The sizes of the two 
modules defining the system where one observes chimera 
order can be varied to see how the ratio of module sizes 
can affect the subsequent evolution of the system. In¬ 
deed, we see that the region in the field-temperature pa¬ 
rameter space over which chimera order is seen increases 
as the ratio increases from I. When the external field is 
withdrawn, the system returns to a structurally balanced 
state with modules of similar sizes if the adaptation rate 
is high. However, for slower learning rates, the system 
becomes completely frustrated. 

We have also tried to explore how the structure of the 
energy landscape of the system evolves during learning. 


Starting from a chimera ordered state that is subjected 
to adaptation rate and external field, we observe changes 
in the landscape after the field is switched off. Initially 
the system becomes completely frustrated. However, af¬ 
ter an interval (which decreases with increasing learning 
rate) the system shows a sudden large increase in the 
basin of attraction of an energy minimum, although the 
frustration of the system has decreased only negligibly. 
This surprisingly radical change in the landscape result¬ 
ing from relatively small degree of change in the interac¬ 
tion structure of the network is a question that needs to 
be explored further. 


It is of interest to consider the implications of the re¬ 
sults reported here for adaptation in biological systems. 
As connections in the brain evolve according to long-term 
potentiation that embodies the Hebbian principle that 
has inspired the link adaptation dynamics used in our 
study, it is natural to expect that the brain may exhibit 
at least some of the features observed here. Indeed, as 
mentioned earlier, the experimental observation of two 
dynamically anti-correlated subnetworks in the resting 
human brain m strongly suggests that in the absence 
of strong external stimulation the underlying network is 
structurally balanced. On the other hand, when exposed 
to stimuli, correlated brain activity is indeed observed - 
although not encompassing the entire network. This is, 
to some extent, reminiscent of the chimera ordered state 
that is seen in our model system. Thus, the brain may be 
seen as corresponding to a system subject to relatively 
fast adaptation rate. However, the Hebbian principle 
can apply to a much broader class of biological systems, 
e.g., gene regulation networks where the co-expression of 
genes has been suggested to result in their co-regulation 
over evolutionary time-scales [l^. As the adaptation in 
this case is provided by natural selection, which is or¬ 
ders of magnitude slower than the learning process in the 
brain mentioned earlier, it is probably not unreasonable 
to conclude that this can be seen as one corresponding to 
our model system subject to slow rate of adaptation. It is 
easy to see that the frustrated system with a large num¬ 
ber of energy minima can be considered to be analogous 
to the cellular differentiation process that allows conver¬ 
gence to any one of a large number of possible cell fates 
dependent upon initial conditions. Indeed this analogy 
has been used earlier by Kauffman to motivate Boolean 
network models for explaining differentiation during bi¬ 
ological development (20|. Extending this analogy, one 
may wonder whether the system has a state correspond¬ 
ing to the ordered state seen on exposing it to an exter¬ 
nal stimulus. As this state is unique and will be attained 
by the system independent of all initial conditions, it is 
tempting to suggest that induced pluripotency in cells 
exposed to chemical stimuli [2l| may be the biological 
analogue. Therefore, it may be of interest to study the 
phenomena reported here in biologically realistic models 
of networks adapting at different time scales. 
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